A NAVIGATIONAL CONTROL SYSTEM 
FOR A ROBOTIC DEVICE 

Cross-Reference to Related Application 

This nonprovisional patent application is based upon and claims priority from U.S. 
provisional patent application Serial No. 60/410,480, filed 13 September 2002, entitled 
Beacon-Based Navigational System. 

This nonprovisional patent application is related to commonly-owned, co-pending 
5 U.S. nonprovisional patent application Serial No. 10/056,804, filed 24 January 2002, 
entitled Method and System for Robot Localization and Confinement, U.S. 
nonprovisional patent application Serial No. 10/320,729, filed 16 December 2002, 
entitled Autonomous Floor-Cleaning Device, U.S. nonprovisional patent application 
Serial No. 10/167,851, filed 12 June 2002, entitled Method and System for Multi-Mode 
1 0 Coverage for an Autonomous Robot, and U.S. nonprovisional continuation-in-part 
patent application Serial No. 10/453,202, filed 03 June 2003, entitled Robot Obstacle 
Detection System, each of which is hereby incorporated by reference. 

Background of the Invention 
(1) Field of the Invention 

The present invention relates generally to mobile robotic devices, and more 
particularly, to a navigational control system for a robotic device operating under the 

1 5 direction of a navigation control algorithm that tracks the movement activity of the 

robotic device and utilizes movement activity to provide one or more control instructions 
to the robotic device, which in response thereto, implements a prescribed conduct, e.g., 
one or more basic maneuvers and/or behavioral patterns to increase the coverage 
efficiency of such robotic devices for covering a defined working area, e.g., sweeping, 

20 vacuuming a room, and/or performing residential yard maintenance. 
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(2) Description of Related Prior Art 

Robotic engineers have long worked on developing an effective method of 
autonomous cleaning. This has led to the development of two separate and distinct 
schemes for autonomous robotic devices: (1) deterministic cleaning; and (2) random 
cleaning. 

5 In deterministic cleaning, where the cleaning rate equals the coverage rate and is, 

therefore, a more efficient cleaning method than random-motion cleaning, the 
autonomous robotic device follows a defined path, e.g., a boustrophedon path that is 
calculated to facilitate complete cleaning coverage of a given area while eliminating 
redundant cleaning. Deterministic cleaning requires that the robotic device maintain 

10 precise position knowledge at all times, as well as its position history (where it has been), 
which, in turn, requires a sophisticated positioning system. A suitable positioning system 
- a positioning system suitably accurate for deterministic cleaning might rely on scanning 
laser ranging systems, ultrasonic transducers, a carrier phase differential GPS, or other 
sophisticated methods - is typically prohibitively expensive and labor intensive, requiring 

1 5 an involved pre-setup to accommodate the unique conditions of each area to be cleaned, 
e.g., room geometry, furniture locations. In addition, methods that rely on global 
positioning are typically incapacitated by failure of any part of the positioning system. 

One illustrative example of a highly sophisticated (and relatively expensive) 
robotic device for deterministic cleaning is the RoboScrub device built by Denning 

20 Mobile Robotics and Windsor Industries. The RoboScrub device employs sonar and 
infrared detectors, bump sensors, and a high-precision laser navigation system to define 
the deterministic cleaning path. The navigation system employed with the RoboScrub 
device requires numerous large bar code targets to be set up in various strategic positions 
within the area to be cleaned, and effective operation of the navigation system requires 

25 that at least four of such targets be visible simultaneously. This target accessibility 

requirement effectively limits the use of the RoboScrub device to large uncluttered open 
areas. 
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Other representative deterministic robotic devices are described in U.S. Patent Nos. 
5,650,702 (Azumi), 5,548,51 1 (Bancroft), 5,537,017 (Feiten et al.), 5,353,224 (Lee et 
al.), 4,700,427 (Knepper), and 4,1 19,900 (Kreimnitz). These representative deterministic 
robotic devices are likewise relatively expensive, require labor intensive pre-setup, and/or 
5 are effectively limited to large, uncluttered areas of simple geometric configuration 
(square, rectangular rooms with minimal (or no) furniture). 

Due to the limitations and difficulties inherent in purely deterministic cleaning 
systems, some robotic devices rely on pseudo-deterministic cleaning schemes such as 
dead reckoning. Dead reckoning consists of continually measuring the precise rotation of 

10 each drive wheel (e.g., using optical shaft encoders) to continually calculate the current 
position of the robotic device, based upon a known starting point and orientation. In 
addition to the disadvantages of having to start cleaning operations from a fixed position 
with the robotic device in a specified orientation, the drive wheels of dead reckoning 
robotic devices are almost always subject to some degree of slippage, which leads to 

1 5 errors in the calculation of current position. Accordingly, dead reckoning robotic devices 
are generally considered unreliable for cleaning operations of any great duration ~ 
resulting in intractable system neglect, i.e., areas of the surface to be cleaned are not 
cleaned. Other representative examples of pseudo-deterministic robotic devices are 
described in U.S. Patent Nos. 6,255,793 (Peless et al.) and 5,109,566 (Kobayashi et al.). 

20 A robotic device operating in random motion, under the control of one or more 

random-motion algorithms stored in the robotic device, represents the other basic 
approach to cleaning operations using autonomous robotic devices. The robotic device 
autonomously implement such random-motion algorithm(s) in response to internal 
events, e.g., signals generated by a sensor system, elapse of a time period (random or 

25 predetermined). In a typical room without obstacles, a robotic device operating under the 
control of a random-motion algorithm will provide acceptable cleaning coverage given 
enough cleaning time. Compared to a robotic device operating in a deterministic 
cleaning mode, a robotic device utilizing a random-motion algorithm must operate for a 
longer period of time to achieve acceptable cleaning coverage. To have a high 
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confidence that a random-motion robotic device has cleaned 98% of an obstacle-free 
room, the random-motion robotic device must run approximately five times longer than a 
deterministic robotic device having similarly sized cleaning mechanisms and moving at 
approximately the same speed. 
5 However, an area to be cleaned that includes one or more randomly-situated 

obstacles causes a marked increase in the running time for a random-motion robotic 
device to effect 98% cleaning coverage. Therefore, while a random motion robotic 
device is a relatively inexpensive means of cleaning a defined working area as contrasted 
to a deterministic robotic device, the random-motion robotic device requires a 
1 0 significantly higher cleaning time. 

A need exists to provide a deterministic component to a random-motion robotic 
device to enhance the cleaning efficiency thereof to reduce the running time for the 
random-motion robotic cleaning to achieve a 98% cleaning coverage. 

Brief Summary of the Invention 

One object of the present invention is to provide a navigational control system that 
1 5 enhances the cleaning efficiency of a robotic device by adding a deterministic component 
(in the form of a conduct prescribed by a navigation control algorithm) to the random 
motion of the robotic device generated by predetermined behavioral modes stored in the 
robotic device. 

Another object of the present invention is to provide a navigational control unit 
20 operating under a navigation control algorithm that includes a predetermined triggering 
event that defines when the prescribed conduct will be implemented by the robotic 
device. 

These and other objects of the present invention are achieved by means of a 
navigational control system for deterministically altering movement activity of a robotic 
25 device operating in a defined working area, comprising a transmitting subsystem 

integrated in combination with the robotic device, the transmitting subsystem comprising 
means for emitting a number of directed beams, each directed beam having a 
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predetermined emission pattern, and a receiving subsystem functioning as a base station 
that includes a navigation control algorithm that defines a predetermined triggering event 
for the navigational control system and a set of detection units positioned within the 
defined working area, the detection units being positioned in a known aspectual 
5 relationship with respect to one another, the set of detection units being configured and 
operative to detect one or more of the directed beams emitted by the transmitting system; 
and wherein the receiving subsystem is configured and operative to process the one or 
more detected directed beams under the control of the navigational control algorithm to 
determine whether the predetermined triggering event has occurred, and, if the 
10 predetermined triggering event has occurred transmit a control signal to the robotic 
device, wherein reception of the control signal by the robotic device causes the robotic 
device to implement a prescribed conduct that deterministically alters the movement 
activity of the robotic device. 

Brief Description of the Drawings 

A more complete understanding of the present invention and the attendant features 
15 and advantages thereof can be had by reference to the following detailed description of 
the invention when considered in conjunction with the accompanying drawings wherein: 
Figure 1 is a top-view schematic of an exemplary robotic device having particular 
utility for use in the navigational control system according to the present invention. 
Figure 2 is an exemplary hardware block diagram for the robotic device of 
20 Figure 1. 

Figure 3 is a schematic depiction of a navigational control system according to the 
present invention that comprises a transmitting subsystem and a receiving subsystem. 

Figure 4 illustrates a polar tessellation of a defined working area in which a robotic 
device is operating. 

25 Figure 5 A illustrates the operation of one preferred embodiment of a transmitting 

subsystem in synchronized operation with the receiving subsystem of a preferred 
embodiment of the navigational control system according to the present invention. 
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Figure 5B illustrates the operation of the receiving subsystem in synchronized 
operation with the transmitting subsystem of Figure 5 A. 

Figure 5C illustrates the operation of another embodiment of a transmitting 
subsystem in synchronized operation with the receiving subsystem of a preferred 
5 embodiment of the navigational control system according to the present invention. 

Figure 5D illustrates the operation of the receiving subsystem in synchronized 
operation with the transmitting subsystem of Figure 5C. 

Figure 6 A illustrates one preferred embodiment of a navigational control system 
according to the present invention wherein the transmitting subsystem in integrated in 
10 combination with the robotic device and the receiving system functions as a base station 
mounted against one wall of a defined working area. 

Figure 6B illustrates the set of transmitting units comprising the transmitting 
subsystem of the robotic device of Figure 6A and representative directed beams having a 
predetermined emission patterns. 
1 5 Figure 6C is a schematic illustration of a preferred embodiment of the receiving 

subsystem of Figure 6 A. 

Figure 7 illustrates an exemplary embodiment of a navigational control system 
according to the present invention wherein the receiving subsystem is integrated in 
combination with the robotic device and the transmitting subsystem has a distributed 
20 configuration. 

Detailed Description of the Invention 

Referring now to the drawings wherein like reference numerals identify 
corresponding or similar elements throughout the several views, Figure 1 is a top-view 
schematic of an exemplary preferred embodiment of a robotic device 100 having 
particular utility in combination with a navigational control system 10 according to the 
25 present invention. Figure 2 is a block diagram of the hardware of the robot device 100 of 
Figure 1. 
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The hardware and behavioral modes (coverage behaviors for cleaning operations; 
escape behaviors for transitory movement patterns; and safety behaviors for emergency 
conditions) of the robotic device 100, which is manufactured, distributed, and/or 
marketed by the iRobot Corporation of Burlington, MA under the ROOMBA trademark, 
5 are briefly described in the following paragraphs to facilitate a more complete 

understanding of the navigational control system 10 of the present invention. Further 
details regarding the hardware and behavioral modes of the robotic device 100 can be 
found in commonly-owned, co-pending U.S. nonprovisional patent application Serial 
No. 10/167,851, filed 12 June 2002, entitled Method and System for Multi-Mode 

1 0 Coverage for an Autonomous Robot, and U.S. nonprovisional patent application Serial 
No. 10/320,729, filed 16 December 2002, entitled Autonomous Floor-Cleaning Device. 

In the following description of the robotic device 100, use of the terminology 
"forward'V'Tore" refers to the primary direction of motion (forward) of the robotic device 
(see arrow identified by reference character "FM" in Figure 1). The fore/aft axis FAx of 

15 the robotic device 100 coincides with the medial diameter of the robotic device 100 that 
divides the robotic device 100 into generally symmetrical right and left halves, which are 
defined as the dominant and non-dominant sides, respectively. 

Robotic device 

The robotic device 100 has a generally cylindrical housing infrastructure that 
includes a chassis 102 and an outer shell 104 secured to the chassis 102 that define a 

20 structural envelope of minimal height (to facilitate movement under furniture). The 
hardware comprising the robotic device 100 can be generally categorized as the 
functional elements of a power system, a motive power system, a sensor system, a control 
module, a side brush assembly, or a self-adjusting cleaning head system, respectively, all 
of which are integrated in combination with the housing infrastructure. In addition to 

25 such categorized hardware, the robotic device 100 further includes a forward bumper 106 
having a generally arcuate configuration and a nose-wheel assembly 108. 
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The forward bumper 106 (illustrated as a single component; alternatively, a two- 
segment component) is integrated in movable combination with the chassis 102 (by 
means of displaceable support members pairs) to extend outwardly therefrom. Whenever 
the robotic device 100 impacts an obstacle (e.g., wall, furniture) during movement 
thereof, the bumper 106 is displaced (compressed) towards the chassis 102 and returns to 
its extended (operating) position when contact with the obstacle is terminated. 

The nose-wheel assembly 108 is mounted in biased combination with the 
chassis 102 so that the nose-wheel subassembly 108 is in a retracted position (due to the 
weight of the robotic device 100) during cleaning operations wherein it rotates freely 
over the surface being cleaned. When the nose-wheel subassembly 108 encounters a 
drop-off during operation (e.g., descending stairs, split-level floors), the nose-wheel 
assembly 1 08 is biased to an extended position. 

The hardware of the power system, which provides the energy to power the 
electrically-operated hardware of the robotic device 100, comprises a rechargeable 
battery pack 1 10 (and associated conduction lines, not shown) that is integrated in 
combination with the chassis 102. 

The motive power system provides the means that propels the robotic device 100 
and operates the cleaning mechanisms, e.g., side brush assembly and the self-adjusting 
cleaning head system, during movement of the robotic device 100. The motive power 
system comprises left and right main drive wheel assemblies 1 12L, 1 12R, their associated 
independent electric motors 114L, 114R, and electric motors 116, 118 for operation of 
the side brush assembly and the self-adjusting cleaning head subsystem, respectively. 

The main drive wheel assemblies 1 12L, 1 12R are independently mounted in biased 
combination with the chassis 102 (for pivotal motion with respect thereto) at opposed 
ends of the transverse diameter (with respect to the fore-aft axis FA X ) of the robotic 
device 100 and are in a retracted position (due to the weight of the robotic device 100) 
during operation thereof wherein the axes of rotation are approximately coplanar with the 
bottom of the chassis 102. If the robotic device 100 is removed from the surface being 
cleaned, the main wheel assemblies 1 12L, 1 12R are pivotally-biased to an extended 
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position wherein their axes of rotation are below the bottom plane of the chassis 102 (in 
this extended position the rechargeable battery pack 1 10 is automatically turned off by 
the control module executing one of the safety behavioral modes). 

The electric motors 1 14L, 1 14R are mechanically coupled to the main drive wheel 
5 assemblies 1 12L, 1 12R, respectively, and independently operated by control signals 
generated by the control module as a response to the implementation of a behavioral 
mode. Independent operation of the electric motors 1 14L, 1 14R allows the main wheel 
assemblies 1 12L, 1 12R to be: (1) rotated at the same speed in the same direction to 
propel the robotic device 100 in a straight line, forward or aft; (2) differentially rotated 

10 (including the condition wherein one wheel assembly is not rotated) to effect a variety of 
right and/or left turning patterns (over a spectrum of sharp to shallow turns) for the 
robotic device 100; and (3) rotated at the same speed in opposite directions to cause the 
robotic device 100 to turn in place, i.e., "spin on a dime", to provide an extensive 
repertoire of movement capability for the robotic device 100. 

1 5 The sensor system comprises a variety of different sensor units that are operative to 

generate signals that control the behavioral mode operations of the robotic device 100. 
The described robotic device 100 includes obstacle detection units 120, cliff detection 
units 122, wheel drop sensors 124, an obstacle-following unit 126, a virtual wall 
omnidirectional detector 128, stall-sensor units 130, and main wheel encoder units 132. 

20 For the described embodiment, the obstacle ("bump") detection units 120 are IR 

break beam sensors mounted in combination with the displaceable support member pairs 
of the forward bumper 106. These detection units 120 are operative to generate one or 
more signals indicating relative displacement between one or more support member pairs 
whenever the robotic device 100 impacts an obstacle such that the forward bumper 106 is 

25 compressed. These signals are processed by the control module to determine an 

approximate point of contact with the obstacle relative to the fore-aft axis FAx of the 
robotic device 100 (and the behavioral mode(s) to be implemented). 

The cliff detection units 122 are mounted in combination with the forward 
bumper 106. Each cliff detection unit 122 comprises an IR emitter - detector pair 
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configured and operative to establish a focal point such that radiation emitted 
downwardly by the emitter is reflected from the surface being traversed and detected by 
the detector. If reflected radiation is not detected by the detector, i.e., a drop-off is 
encountered, the cliff detection unit 122 transmits a signal to the control module (which 
5 causes one or more behavioral modes to be implemented). 

A wheel drop sensor 124 such as a contact switch is integrated in combination with 
each of the main drive wheel assemblies 1 12L, 1 12R and the nose wheel assembly 108 
and is operative to generate a signal whenever any of the wheel assemblies is in an 
extended position, i.e., not in contact with the surface being traversed, (which causes the 

10 control module to implement one ore more behavioral modes). 

The obstacle-following unit 126 for the described embodiment is an IR emitter - 
detector pair mounted on the 'dominant' side (right hand side of Figure 1) of the robotic 
device 100. The emitter - detector pair is similar in configuration to the cliff detection 
units 1 12, but is positioned so that the emitter emits radiation laterally from the dominant 

15 side of the robotic device 100. The unit 126 is operative to transmit a signal to the 

control module whenever an obstacle is detected as a result of radiation reflected from the 
obstacle and detected by the detector. The control module, in response to this signal, 
causes one or more behavioral modes to be implemented. 

A virtual wall detection system for use in conjunction with the described 

20 embodiment of the robotic device 1 00 comprises an omnidirectional detector 128 
mounted atop the outer shell 104 and a stand-alone transmitting unit (not shown) that 
transmits an axially-directed confinement beam. The stand-alone transmitting unit is 
positioned so that the emitted confinement beam blocks an accessway to a defined 
working area, thereby restricting the robotic device 100 to operations within the defined 

25 working area (e.g., in a doorway to confine the robotic device 100 within a specific room 
to be cleaned). Upon detection of the confinement beam, the omnidirectional 
detector 128 transmits a signal to the control module (which causes one or more 
behavioral modes to be implemented to move the robotic device 100 away from the 
confinement beam generated by the stand-alone transmitting unit). 
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A stall sensor unit 130 is integrated in combination with each electric motor 1 14L, 
1 14R, 1 16, 1 18 and operative to transmit a signal to the control module when a change in 
current is detected in the associated electric motor (which is indicative of a dysfunctional 
condition in the corresponding driven hardware). The control module is operative in 
5 response to such a signal to implement one or more behavioral modes. 

An TR encoder unit 132 (see Figure 2) is integrated in combination with each main 
wheel assembly 1 12L, 1 12R and operative to detect the rotation of the corresponding 
wheel and transmit signals corresponding thereto the control module (wheel rotation can 
be used to provide an estimate of distance traveled for the robotic device 100). 

10 The control module comprises the microprocessing unit 135 illustrated in Figure 2 

that includes I/O ports connected to the sensors and controllable hardware of the robotic 
device 100, a microcontroller, and ROM and RAM memory. The I/O ports function as 
the interface between the microcontroller and the sensor units and controllable hardware, 
transferring signals generated by the sensor units to the microcontroller and transferring 

1 5 control (instruction) signals generated by the microcontroller to the controllable hardware 
to implement a specific behavioral mode. 

The microcontroller is operative to execute instruction sets for processing sensor 
signals, implementing specific behavioral modes based upon such processed signals, and 
generating control (instruction) signals for the controllable hardware based upon 

20 implemented behavioral modes for the robotic device 100. The cleaning coverage and 
control programs for the robotic device 100 are stored in the ROM of the 
microprocessing unit 135, which includes the behavioral modes, sensor processing 
algorithms, control signal generation algorithms and a prioritization algorithm for 
determining which behavioral mode or modes are to be given control of the robotic 

25 device 100. The RAM of the microprocessing unit 135 is used to store the active state of 
the robotic device 100, including the ID of the behavioral mode(s) under which the 
robotic device 100 is currently being operated and the hardware commands associated 
therewith. 
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The side brush assembly 140 is configured and operative to entrain particulates 
outside the periphery of the housing infrastructure and to direct such particulates towards 
the self-adjusting cleaning head system. The side brush assembly 140 provides the 
robotic device 100 with the capability of cleaning surfaces adjacent to base-boards when 

5 the robotic device is operated in an Obstacle-Following behavioral mode. As shown in 
Figure 1, the side brush assembly 140 is preferably mounted in combination with the 
chassis 102 in the forward quadrant on the dominant side of the robotic device 100. 

The self-adjusting cleaning head system 145 for the described robotic device 100 
comprises a dual-stage brush assembly and a vacuum assembly, each of which is 

10 independently powered by an electric motor (reference numeral 1 18 in Figure 1 actually 
identifies two independent electric motors - one for the brush assembly and one for the 
vacuum assembly). The cleaning capability of the robotic device 100 is commonly 
characterized in terms of the width of the cleaning head system 145 (see reference 
character W in Figure 1). 

1 5 The dual-stage brush assembly and the inlet of the vacuum assembly are integrated 

in combination with a deck structure, which is pivotally mounted in combination with the 
chassis 102 and operatively integrated with the motor of the dual-stage brush assembly. 
In response to a predetermined reduction in rotational speed of the brush assembly motor, 
the brush assembly motor provides the motive force to pivot the deck structure with 

20 respect to the chassis 102. The pivoting deck structure provides the self adjusting 

capability for the cleaning head assembly 145, which allows the robotic device 100 to 
readily transition between disparate surfaces during cleaning operations, e.g., carpeted 
surface to bare surface or vice versa, without hanging up. 

The dual-stage brush assembly comprises asymmetric, counter-rotating brushes that 

25 are positioned (forward of the inlet of the vacuum assembly), configured and operative to 
direct particulate debris into a removable dust cartridge (not shown). The positioning, 
configuration, and operation of the brush assembly concomitantly directs particulate 
debris towards the inlet of the vacuum assembly such that particulates that are not swept 
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up by the dual-stage brush assembly can be subsequently ingested by the vacuum 
assembly as a result of movement of the robotic device 100. 

Operation of the vacuum assembly independently of the self-adjustable brush 
assembly allows the vacuum assembly to generate and maintain a higher vacuum force 
5 using a battery-power source than would be possible if the vacuum assembly were 
operated in dependence with the brush assembly. 

Behavioral Modes for Robotic device 

The robotic device 100 uses a variety of behavioral modes to effectively clean a 
defined working area where behavioral modes are layers of control systems that can be 
operated in parallel. The microprocessor unit 135 is operative to execute a prioritized 

10 arbitration scheme to identify and implement one or more dominant behavioral modes for 
any given scenario based upon inputs from the sensor system. 

The behavioral modes for the described robotic device 100 can be characterized as: 
(1) coverage behavioral modes; (2) escape behavioral modes; and (3) safety behavioral 
modes. Coverage behavioral modes are primarily designed to allow the robotic 

15 device 100 to perform its cleaning operations in an efficient and effective manner and the 
escape and safety behavioral modes are priority behavioral modes implemented when a 
signal from the sensor system indicates that normal operation of the robotic device 100 is 
impaired, e.g., obstacle encountered, or is likely to be impaired, e.g., drop-off detected. 
Representative and illustrative coverage behavioral (cleaning) modes for the 

20 robotic device 100 include: (1) a Spot Coverage pattern; (2) an Obstacle-Following (or 
Edge-Cleaning) Coverage pattern, and (3) a Room Coverage pattern. The Spot 
Coverage pattern causes the robotic device 100 to clean a limited area within the defined 
working area, e.g., a high-traffic area. In a preferred embodiment the Spot Coverage 
pattern is implemented by means of a spiral algorithm (but other types of self-bounded 

25 area algorithms, e.g., polygonal, can be used). The spiral algorithm, which causes 

outward spiraling (preferred) or inward spiraling movement of the robotic device 100, is 
implemented by control signals from the microprocessing unit 1 35 to the main wheel 
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assemblies 1 12L, 1 12R to change the turn radius/radii thereof as a function of time 
(thereby increasing/decreasing the spiral movement pattern of the robotic device 100). 

The robotic device 100 is operated in the Spot Coverage pattern for a 
predetermined or random period of time, for a predetermined or random distance (e.g., a 
5 maximum spiral distance) and/or until the occurrence of a specified event, e.g., activation 
of one or more of the obstacle detection units 120 (collectively a transition condition). 
Once a transition condition occurs, the robotic device 100 can implement or transition to 
a different behavioral mode, e.g., a Straight Line behavioral mode (in a preferred 
embodiment of the robotic device 100, the Straight Line behavioral mode is a low 

10 priority, default behavior that propels the robot in an approximately straight line at a 

preset velocity of approximately 0.306 m/s) or a Bounce behavioral mode in combination 
with a Straight Line behavioral mode. 

If the transition condition is the result of the robotic device 100 encountering an 
obstacle, the robotic device 100 can take other actions in lieu of transitioning to a 

1 5 different behavioral mode. The robotic device 1 00 can momentarily implement a 

behavioral mode to avoid or escape the obstacle and resume operation under control of 
the spiral algorithm (i.e., continue spiraling in the same direction). Alternatively, the 
robotic device 100 can momentarily implement a behavioral mode to avoid or escape the 
obstacle and resume operation under control of the spiral algorithm (but in the opposite 

20 direction - reflective spiraling). 

The Obstacle-Following Coverage pattern causes the robotic device 100 to clean 
the perimeter of the defined working area, e.g., a room bounded by walls, and/or the 
perimeter of an obstacle (e.g., furniture) within the defined working area. Preferably the 
robotic device 100 utilizes obstacle-following unit 126 to continuously maintain its 

25 position with respect to an obstacle, e.g., wall, furniture, so that the motion of the robotic 
device 100 causes it to travel adjacent to and concomitantly clean along the perimeter of 
the obstacle. Different embodiments of the obstacle-following unit 126 can be used to 
implement the Obstacle-Following behavioral pattern. 
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In a first embodiment, the obstacle-following unit 126 is operated to detect the 
presence or absence of the obstacle. In an alternative embodiment, the obstacle- 
following unit 126 is operated to detect an obstacle and then maintain a predetermined 
distance between the obstacle and the robotic device 100. In the first embodiment, the 
5 microprocessing unit 135 is operative, in response to signals from the obstacle-following 
unit, to implement small C W or CC W turns to maintain its position with respect to the 
obstacle. The robotic device 100 implements a small CW when the robotic device 100 
transitions from obstacle detection to non-detection (reflection to non-reflection) or to 
implement a small CCW turn when the robotic device 100 transitions from non-detection 

1 0 to detection (non-reflection to reflection). Similar turning behaviors are implemented by 
the robotic device 100 to maintain the predetermined distance from the obstacle. 

The robotic device 100 is operated in the Obstacle-Following behavioral mode for 
a predetermined or random period of time, for a predetermined or random distance (e.g., 
a maximum or minimum distance) and/or until the occurrence of a specified event, e.g., 

1 5 activation of one or more of the obstacle detection units 120 a predetermined number of 
times (collectively a transition condition). In certain embodiments, the 
microprocessor 135 will cause the robotic device to implement an Align behavioral mode 
upon activation of the obstacle-detection units 120 in the Obstacle-Following behavioral 
mode wherein the implements a minimum angle CCW turn to align the robotic 

20 device 100 with the obstacle. 

The Room Coverage pattern can be used by the robotic device 100 to clean any 
defined working area that is bounded by walls, stairs, obstacles or other barriers (e.g., a 
virtual wall unit). A preferred embodiment for the Room Coverage pattern comprises the 
Random-Bounce behavioral mode in combination with the Straight Line behavioral 

25 mode. Initially, the robotic device 100 travels under control of the Straight-Line 

behavioral mode, i.e., straight-line algorithm (main drive wheel assemblies 1 12L, 1 12R 
operating at the same rotational speed in the same direction) until an obstacle is 
encountered. Upon activation of one or more of the obstacle detection units 120, the 
microprocessing unit 135 is operative to compute an acceptable range of new directions 
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based upon the obstacle detection unit(s) 126 activated. The microprocessing unit 135 
selects a new heading from within the acceptable range and implements a C W or CCW 
turn to achieve the new heading with minimal movement. In some embodiments, the 
new turn heading may be followed by forward movement to increase the cleaning 
5 efficiency of the robotic device 100. The new heading may be randomly selected across 
the acceptable range of headings, or based upon some statistical selection scheme, e.g., 
Gaussian distribution. In other embodiments of the Room Coverage behavioral mode, 
the microprocessing unit 135 can be programmed to change headings randomly or at 
predetermined times, without input from the sensor system. 

10 The robotic device 100 is operated in the Room Coverage behavioral mode for a 

predetermined or random period of time, for a predetermined or random distance (e.g., a 
maximum or minimum distance) and/or until the occurrence of a specified event, e.g., 
activation of the obstacle-detection units 120 a predetermined number of times 
(collectively a transition condition). 

15 A preferred embodiment of the robotic device 100 includes four escape behavioral 

modes: a Turn behavioral mode, an Edge behavioral mode, a Wheel Drop behavioral 
mode, and a Slow behavioral mode. One skilled in the art will appreciate that other 
behavioral modes can be utilized by the robotic device 100. One or more of these 
behavioral modes may be implemented, for example, in response to a current rise in one 

20 of the electric motors 1 16, 1 1 8 of the side brush assembly 140 or dual-stage brush 

assembly above a low or high stall threshold, forward bumper 106 in compressed position 
for determined time period, detection of a wheel-drop event. 

In the Turn behavioral mode, the robotic device 100 turns in place in a random 
direction, starting at higher velocity (e.g., twice normal turning velocity) and decreasing 

25 to a lower velocity (one-half normal turning velocity), i.e., small panic turns and large 
panic turns, respectively. Low panic turns are preferably in the range of 45° to 90°, large 
panic turns are preferably in the range of 90° to 270°. The Turn behavioral mode 
prevents the robotic device 100 from becoming stuck on room impediments, e.g., high 
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spot in carpet, ramped lamp base, from becoming stuck under room impediments, e.g., 
under a sofa, or from becoming trapped in a confined area. 

In the Edge behavioral mode follows the edge of an obstacle unit it has turned 
through a predetermined number of degrees, e.g., 60°, without activation of any of the 
5 obstacle detection units 120, or until the robotic device has turned through a 

predetermined number of degrees, e.g., 170°, since initiation of the Edge behavioral 
mode. The Edge behavioral mode allows the robotic device 100 to move through the 
smallest possible openings to escape from confined areas. 

In the Wheel Drop behavioral mode, the microprocessor 135 reverses the direction 
10 of the main wheel drive assemblies 1 12L, 1 12R momentarily, then stops them. If the 
activated wheel drop sensor 124 deactivates within a predetermined time, the 
microprocessor 135 then reimplements the behavioral mode that was being executed 
prior to the activation of the wheel drop sensor 124. 

In response to certain events, e.g., activation of a wheel drop sensor 124 or a cliff 
1 5 detector 122, the Slow behavioral mode is implemented to slowed down the robotic 

device 100 for a predetermined distance and then ramped back up to its normal operating 
speed. 

When a safety condition is detected by the sensor subsystem, e.g., a series of brush 
or wheel stalls that cause the corresponding electric motors to be temporarily cycled off, 
20 wheel drop sensor 124 or a cliff detection sensor 122 activated for greater that a 

predetermined period of time, the robotic device 100 is generally cycled to an off state. 
In addition, an audible alarm may be generated. 

The foregoing description of behavioral modes for the robotic device 100 are 
intended to be representative of the types of operating modes that can be implemented by 
25 the robotic device 100. One skilled in the art will appreciate that the behavioral modes 
described above can be implemented in other combinations and/or circumstances. 
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Navigational Control System 

Figure 3 is a schematic representation of a navigational control system 10 
according to the present invention for use in combination with a robotic device 100 to 
enhance the cleaning efficiency thereof by adding a deterministic component (in the form 
of a control signal that remotely controls the movement of the robotic device 100) to the 

5 motion algorithms, including random motion, autonomously implemented by the robotic 
device 100. The navigational control system 10 comprises a transmitting subsystem 12 
and a receiving subsystem 20 operating under the direction of a navigation control 
algorithm. The navigation control algorithm includes a definition of a predetermined 
triggering event. The specific features and characteristics of the transmitting 

10 subsystem 12 and the receiving subsystem 20 depend upon whether the particular 
subsystem is integrated in combination with the robotic device 100 or functions as a 
"base station" for the navigational control system 10. 

Broadly described, the navigational control system 10 according to the present 
invention is operative, under the direction of the navigation control algorithm, to monitor 

15 the movement activity of the robotic device 1 00 within the defined working area. In one 
preferred embodiment, the monitored movement activity is defined in terms of the 
"position history" of the robotic device 100 as described in further detail below. In 
another preferred embodiment, the monitored movement activity is defined in terms of 
the "instantaneous position" of the robotic device 100 as defined in further detail below. 

20 The predetermined triggering event is a specific occurrence or condition in the 

movement activity of the robotic device 100. Upon the realization of the predetermined 
triggering event, the navigational control system 10 is operative to generate and 
communicate a control signal to the robotic device 100. In response to the control signal, 
the robotic device 100 is operative to implement or execute a conduct prescribed by the 

25 control signal, i.e., the prescribed conduct. This prescribed conduct represents a 
deterministic component of the movement activity of the robotic device 100. 

In the preferred embodiment of the navigational control system 10 based upon 
position history, the system 10 is configured and operative to create a "tessellation" of 
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any defined working area where the robotic device 100 is to be operated, e.g., a room to 
be cleaned. Tessellate is used herein in the sense that the defined working area is 
segmented into a set of individual cells, which may or may not be of equal size. For 
example, Figure 4 exemplarily illustrates the polar tessellation of a defined working area 

5 into a set of individual cells C (reference characters BS T identify the "base station") of 
unequal size. The position of each cell C (in terms of its center) is identified in terms of 
polar coordinates (r, 8) referenced to the base station BSt as the origin (0, 0). A grid map 
of the cells C comprising the defined working area is stored in memory of the navigation 
control system 10. One skilled in the art will appreciate that other coordinate systems, 

10 e.g., a planar Cartesian coordinate system, can be used by the navigational control 

system 10 to define the position of individual cells C within the predetermined working 
area. 

Preferably, the navigational control system 10 is operative to define the size the 
individual cells C so that the length and width dimensions of an individual cell C are no 

15 larger than one-half the width (W) of the cleaning head system 145 of the robotic 
device 100 (see Figure 1 and corresponding discussion above). 

The navigational control system 10 is operative to generate a position history of the 
robotic device 100 within the defined working area in terms of such individual cells C (to 
minimize the memory requirements for storage of position history). The position history 

20 comprises a set of discrete, instantaneous positions (in terms of individual cells C) of the 
robotic device 100 over a time interval where the time interval is a variable that depends 
upon the "triggering condition" of the navigation control algorithm implemented by the 
navigational control system 10. 

Each discrete instantaneous position of the robotic device 100 is determined by 

25 operating the transmitting subsystem 12 to emit a set of directional beams and operating 
the receiving subsystem 20 to detect one or more of such directional beams and process a 
signal parameter of the detected beam(s) to determine an absolute bearing parameter and 
a distance parameter between the transmitting subsystem 12 and the receiving 
subsystem 20 at a point in time. Each pair of bearing, distance parameters establishes a 
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discrete instantaneous position for the robotic device 100. For the preferred 'position 
history' embodiment, the navigational control system 10 is operative to correlate each 
discrete instantaneous position to one individual cell C of the grid map. A set of bearing 
and position pairs, i.e., a set of instantaneous positions, over a time interval defines a set 
5 of cells C, which are identified in the receiving subsystem 20 as the position history of 
the robotic device 100 for the time interval. 

In the preferred embodiment of the navigational control system 10 based upon the 
instantaneous position, the system 10 processes each discrete instantaneous position as it 
is established, under the control of the navigation control algorithm, to determine whether 

1 0 such discrete instantaneous position is the predetermined triggering event defined by the 
navigation control algorithm. 

In an advanced embodiment of the navigational control system 10, the system 10 is 
additionally configured and operative to determine a travel vector (indicating the 
direction of motion of the robotic device 100 within an individual cell C or at the discrete 

1 5 instantaneous position) at each point in time. These travel vectors may be stored in 
memory in conjunction with the corresponding cells C as a component of the position 
history of the robotic device 100. 

The navigational control system 10 according to the present invention is further 
operative, under direction of the navigational control algorithm, to generate and 

20 communicate a control signal to the robotic device 100 whenever the navigational control 
system 100 realizes the predetermined triggering event. In response to any such control 
signal, the robotic device 100 is configured and operative to initiate a prescribed conduct. 
The prescribed conduct comprises the deterministic component added to the random 
motion movement activity of the robotic device 100 by means of the navigational control 

25 system 10 according to the present invention. 

In one preferred embodiment of the invention, the prescribed conduct of the robotic 
device 100 comprises one or more basic maneuvers such as CW and CCW turns, forward 
or aft (straight line) movement, slow down, speed up, and stop. The CW and/or CCW 
turns can be implemented using the turning techniques of the robotic device 100 
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described above, and the turn angles can be, for example, over a 360° spectrum at 
predetermined intervals, e.g., 5° or 10°. Alternatively, or in addition to, the CW and/or 
CC W turns can be to a specified azimuthal heading (referenced to the base station as the 
origin) where the navigational control system 10 is configured and operative so that the 
5 travel vector is a determinable variable. Of these basic maneuvers, forward (straight line) 
movement is typically the default maneuver that the robotic device 100 automatically 
reverts to (implements) once one or more of the other basic maneuvers has been 
completed. 

In another preferred embodiment of the invention, the prescribed conduct of the 
10 robotic device 100 comprises one or more of the behavioral modes described herein. In 
yet a further preferred embodiment of the invention, the prescribed conduct of the robotic 
device 100 comprises a combination of the basic maneuvers and the behavioral modes 
described herein. 

The transmitting subsystem 12 is operative to transmit a number of directed beams 
1 5 having a predetermined emission pattern along a specific propagation axis. Preferably, 
the directed beams are planar, i.e., substantially parallel to the surface of the defined 
working area. 

In preferred embodiments of the navigational control system 10 according to the 
present invention, the transmitting subsystem 12 is integrated in combination with the 

20 robotic device 100. The transmitting subsystem 12 is configured and operative to 

functionally emulate an omnidirectional transmission source with respect to the defined 
working area, i.e., by emitting a plurality of directed beams that cover the defined 
working area. For these preferred embodiments, the robotic device 100 further includes a 
receiver unit 16 (see Figure 3) configured and operative to receive control signals from 

25 the receiving subsystem 20 (see discussion below regarding the transmitting unit 32 of 
the receiving subsystem 20). While the receiver unit 16 is depicted as a dedicated 
receiving unit for the control signals, it is preferable that the omnidirectional detector 128 
(of the virtual wall detection system) described above be adapted to detect and process 
such control signals. 
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In one preferred embodiment, the transmitting subsystem 12 comprises a 
conventional mechanical sweeping transmitter, e.g., a laser, that is integrated in 
combination with a high point of the housing infrastructure of the robotic device 100 so 
that none of the structural features of the robotic device 100 interfere with the operation 
5 thereof. The mechanical sweeping transmitter is configured and operative to emit the 
plurality of directed beams while concomitantly redirecting (mechanically sweeping) the 
transmitting element so that each directed beam has a different propagation axis. Other 
features and characteristics of the mechanical sweeping transmitter are described below 
in terms of individual transmitting units 14 N for ease of description. 

10 Another preferred embodiment of the transmitting subsystem 12 comprises a set of 

transmitting units 14n> where N is an integer defining the number of individual 
transmitting units comprising the set for the navigational control system 10, that are 
integrated in combination with the robotic device 100 about the periphery of its housing 
infrastructure. Each transmitting unit 14N is configured and operative to emit a directed 

1 5 beam having a predetermined emission pattern along a specific propagation axis. 

Preferably, the transmitting subsystem 12 is configured and operative so that the emitted 
directed beams are planar. 

In a basic embodiment of the transmitting subsystem 12, the transmitting units 14 N 
are fungible/interchangeable, each operating to emit a directed beam at a common 

20 operating frequency. Preferably, the common operating frequency for the transmitting 
units 14 N lies in the infrared range, i.e., about 750 nm to about 1.4 x 10 4 nm, preferably 
about 880 nm to about 980 nm, although one skilled in the art will appreciate that other 
wavelengths, e.g., in the radio frequency range, microwave frequency range, can be used 
in the practice of the navigational control system 10 of the present invention. 

25 Preferably, the common operating frequency directed beams emitted by the 

transmitting units 14n are periodically modulated, e.g., at 10 KHz for 50 msec, off for 
300 msec. Modulation of the directed beams facilitates detection thereof by the receiving 
subsystem 20, i.e., the receiving subsystem 20 is able to readily discriminate between 
modulated directed beams emitted by the transmitting subsystem 12 and any other 
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electromagnetic radiation sources that may be active in the defined working area, e.g., 
television remote control units, wireless computer keyboards, microwaves, ambient 
radiation such as sunlight. For the basic embodiment, it is also preferable that the 
transmitting units 14 N be sequentially operated so that any transmitting unit 14n is cycled 
5 on for a predetermined period of time and then cycled off, the next (adjacent) 

transmitting unit 14n is then cycled on for the predetermined period of time and cycled 
off, and so forth. Operating the transmitting subsystem 12 in the foregoing manner, i.e., 
modulation of the directed beam, cycling transmitting units 14n on/off sequentially, 
minimizes the power requirements of the transmitting subsystem 12 and reduces spurious 
10 noise/collateral energy that could adversely impact the functioning of the navigational 
control system 10. 

Ordinarily, a navigational control system 10 employing the basic embodiment of 
the transmitting subsystem 12, i.e., all transmitting units 14n are interchangeable — 
emitting directed beams at a common operating frequency, cannot be used to determine 

15 travel vectors for the robotic device 100 because the receiving subsystem 20 cannot 

differentiate between directed beams emitted by the transmitting units 14 N and therefore 
cannot identify any particular transmitting unit 14n. However, the inventors have 
developed two innovative ways of transmitting and processing directed beams emitted by 
a transmitting subsystem 12 comprised of interchangeable transmitting units 14N so that 

20 the receiving subsystem 20 can individually identify a specific interchangeable 

transmitting unit 14N, and, based upon such identification, establish a travel vector for 
the robotic device 100. 

Accordingly, in one enhanced version of the basic embodiment of the transmitting 
subsystem 12, interchangeable transmitting units 14N are operated in a predetermined 

25 manner that allows the receiving subsystem 20 to process detected directed beams to 
identify the directed beam having the highest signal strength, which, in turn, allows the 
receiving subsystem 20 to identify the interchangeable transmitting unit 14 N that emitted 
such directed beam. This, in turn, allows the receiving subsystem 20 to determine the 
orientation and, hence the travel vector, of the robotic device 100. 
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Referring to Figure 5 A, the transmitting subsystem 12 is first cycled on so that all 
transmitting units 14n emit directed beams for a predetermined synchronization period, as 
identified by reference character tsy, and then cycled off. The receiver subsystem 20 is 
operative to detect and process one or more of the directed beams emitted by the 
5 transmitting units 14n and identify the predetermined synchronization period tsy of the 
transmitting subsystem 12. This identification allows the receiving subsystem 20 to 
synchronize operations between the transmitting subsystem 12 and the receiving 
subsystem 20 by initializing a timing sequence at the end of the predetermined 
synchronization period tsy (reference character to identifies the initialization of the timing 

10 sequence in Figure 5 A). 

The transmitting subsystem 12 is further operative so that individual transmitting 
unit 14 N are sequentially cycled on and off at predetermined times with respect to the 
timing sequence initialization to established by the receiving subsystem 20. For example, 
with respect to Figure 5 A, which illustrates a transmitting subsystem 12 comprising four 

15 transmitting units 14n (arbitrarily identified as the first transmitting unit 14i, the second 
transmitting unit 14 2 , the third transmitting unit 14 3 , and the fourth transmitting unit 14 4 ), 
the transmitting subsystem 12 is configured and operative so that each of the transmitting 
units 14i, 142, 143, 14 4 is sequentially cycled on to emit a directed beam that transitions 
from a zero (0) signal strength to a peak signal strength to a zero (0) signal strength and 

20 then cycled off (a saw-tooth transition pattern is exemplarily illustrated in Figure 5 A - 
one skilled in the art will appreciate that other types of signal strength transition patterns 
can be used in the practice of the invention described herein, e.g., a ramped signal 
strength). 

That is, the first transmitting unit 14i is cycled on and transitions to a peak signal 
25 strength at time ti. The second transmitting unit 14 2 is cycled on as the directed beam 
from the first transmitting unit 14i achieves its peak signal strength at time ti. The 
second transmitting unit 14 2 transitions to a peak signal strength at time t 2 , at which point 
the first transmitting unit 14i has transitioned to a zero (0) signal strength and is cycled 
off. The third transmitting unit 14 3 is cycled on as the directed beam from the second 
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transmitting unit 142 achieves its peak signal strength at time t 2 . The foregoing operating 
pattern is repeated for the second, third, and fourth transmitting units 14 2 , 14 3 , 14 4 , as 
applicable, so that at time t3 the second transmitting unit 14 2 is cycled off, the directed 
beam emitted by the third transmitting unit 143 has achieved its peak signal strength, and 
5 the fourth transmitting unit 14 4 is cycled on; and at time U the third transmitting unit 14 3 
is cycled off and the directed beam emitted by the fourth transmitting unit 14 4 has 
achieved its peak strength. The transmitting subsystem 12 is operative to repeat the 
above-described synchronization - sequential transmission procedure during operation of 
the navigational control system 12 according to the present invention. 

10 In another enhanced version of the basic embodiment of the transmitting 

subsystem 12, interchangeable transmitting units 14N are operated in a different 
predetermined manner that allows the receiving subsystem 20 to process detected 
directed beams to identify the directed beam having the highest signal strength, which, in 
turn, allows the receiving subsystem 20 to identify the interchangeable transmitting 

1 5 unit 14n that emitted such directed beam. This, in turn, allows the receiving 

subsystem 20 to determine the orientation and, hence the travel vector, of the robotic 
device 100. 

Referring to Figure 5C, the transmitting subsystem 12 is first cycled on so that all 
transmitting units 14 N emit directed beams for a predetermined synchronization period, as 

20 identified by reference character tn, and then cycled off. The receiver subsystem 20 is 
operative to detect and process one or more of the directed beams emitted by the 
transmitting units 14 N and identify the predetermined synchronization period tn of the 
transmitting subsystem 12. This identification allows the receiving subsystem 20 to 
synchronize operations between the transmitting subsystem 12 and the receiving 

25 subsystem 20 by initializing a timing sequence at the end of the predetermined 

synchronization period tsy (reference character to identifies the initialization of the timing 
sequence in Figure 5 A). 

The transmitting subsystem 12 is further operative so that individual transmitting 
unit 14 N are sequentially cycled on and off at predetermined times with respect to the 
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timing sequence initialization to established by the receiving subsystem 20. For example, 
with respect to Figure 5C, which illustrates a transmitting subsystem 12 comprising four 
transmitting units 14n (arbitrarily identified as the first transmitting unit 14i, the second 
transmitting unit 142, the third transmitting unit 143, and the fourth transmitting unit H4), 
5 the transmitting subsystem 12 is configured and operative so that each of the transmitting 
units 14i, 14 2 , 14 3 , 14 4 is sequentially cycled on to emit a pulsed directed beam have a 
predetermined pulse width Pi, P 2 , P3, P4, respectively, at a predetermined signal strength, 
and then cycled off. 

That is, the first transmitting unit 14i is cycled on at tn (where the first "1" 

10 identifies the transmitting unit number and the second "1 " indicates that the transmitting 
unit is cycled on) and cycled off at t i2 (where the "2" indicates that the transmitting unit is 
cycled off). In a similar manner, the second transmitting unit 14 2 is cycled on at t 2 i and 
cycled off at t 22 , the third transmitting unit M3 is cycled on at t 3 i and cycled off at t 32 , and 
fourth transmitting units H4 is cycled on at Ui and cycled off at U2. The transmitting 

15 subsystem 12 is operative to repeat the above-described synchronization - sequential 
transmission procedure during operation of the navigational control system 12 according 
to the present invention. 

In a more sophisticated embodiment of the transmitting subsystem 12, the 
transmitting units 14n are discrete and identifiable, each transmitting unit 14n operating 

20 at a unique operating frequency to emit a directed beam (which is preferably planar with 
respect to the surface of the defined working area) having a predetermined emission 
pattern along a specific propagation axis. These operating frequencies are also preferably 
modulated to facilitate detection thereof by the receiving subsystem 20 in an environment 
where other electromagnetic radiation sources are operating. Since each directed beam is 

25 readily and uniquely identifiable, the receiving subsystem 20 can process detected 

directed beams in a conventional manner to derive not only the absolute bearing and to 
the robotic device 100, but also the travel vector for the robotic device 10 at any 
particular time. 
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The receiving subsystem 20 of the navigational control system 10 according to the 
present invention comprises a processing unit 22 that includes a microprocessor 24, a 
signal processing unit 26, a memory module 28, and a set of detection units 30m. 
Additionally, the receiving subsystem 20 can also include a transmitting unit 32 for those 
5 preferred embodiments of the navigational control system 10 wherein the receiving 
subsystem 20 is operated or functions as the base station for the navigational control 
system 10. 

The memory module 28 comprises RAM 28A and ROM 28B. Data relating to the 
current operation of the robotic device 100 within the defined working area is stored in 

1 0 the RAM 28A. Such current operational data can include the grid map of cells C 
defining the defined working area and the position history of the robotic device 100 
within the defined working area for the 'position history' embodiment of the navigational 
control system 10. Stored in the ROM 28B are one or more navigation control 
algorithms for the navigational control system 10, a set of one or more control signals 

1 5 associated with each navigation control algorithm, and a signal processing algorithm for 
converting signals generated by the signal processing unit 26 to one or more sets of 
instantaneous position parameters, i.e., a bearing, distance pair (and travel vector, if 
applicable). For the 'position history' embodiment of the system 10, a set of 
instantaneous position parameters that define the position history of the robotic 

20 device 100, which are correlated with the grid map to identify the cells C comprising the 
position history. 

The terminology "navigation control algorithm" as used herein encompasses a set 
of instructions that: (a) define how the position history or instantaneous position is used 
by the navigational control system 10 (e.g., counting and comparing cells visited, a true- 
25 false determination for cells visited, true-false determination whether the predetermined 
triggering event has occurred); (b) defines the triggering event or events associated with 
the use of the position history or the instantaneous position; and (c) identifies the control 
signal(s) to be implemented when the triggering event is realized. For example, in one 
representative navigation control algorithm for the 'position history' embodiment of the 
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navigational control system 10 according to the present invention, the microprocessor 24 
is operative to count and store the number of visits to each cell and to compute the total 
number of visits to cells contiguous to (neighboring) each such visited cell (cell 
counting). The microprocessor 24 is further operative to compare the total number of 
5 neighboring-cell visits as each cell is visited to a threshold value (see, e.g., Figure 4 
wherein "Cv" identifies a visited cell and "Cc" identifies the eight (8) cells contiguous to 
the visited cell Cy), If the total number of neighboring-visits (e.g., fifteen (15) in the 
example of Figure 4) for any visited cell is below the threshold number (the triggering 
event), the microprocessor 24 is operative to cause a control signal to be communicated 

10 to the robotic device 100. The control signal causes the robotic device 100 to implement 
one or more behavioral modes specified by the control signal, e.g., a Spot Coverage 
pattern as described above. 

In another representative navigation control algorithm for the 'position history' 
embodiment of the navigational control system 10 of the present invention, one or more 

1 5 cells in the stored grid map are pre-identified (i.e., prior to operating the robotic 

device 100) as "hot spots" in the defined working area. As the robotic device 100 visits 
any particular cell C, the microprocessor 24 is operative to determine whether the visited 
cell has been identified as a "hot spot" (true-false determination). If the 
microprocessor 24 determines that the visited cell C is a "hot spot" (triggering event), the 

20 microprocessor 24 is operative to cause a control signal to be communicated to the 

robotic device 100 via the control signal transmitting unit 32. Reception of the control 
signal causes the robotic device 100 to implement the prescribed conduct specified by the 
control signal, e.g., one or more of the basic maneuvers described above and/or a Spot 
Coverage pattern or Obstacle-Following behavioral mode as described above. 

25 The foregoing representative examples of navigation control algorithms for the 

'position history' embodiment of the navigational control system 10 according to the 
present invention are implemented without knowledge of the travel vector of the robotic 
device 100, i.e., based solely upon the identification of visited cells by means of the 
bearing, distance parameters derived by the receiving subsystem 20. Another 
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representative example of a navigation control algorithm for the 'position history- 
embodiment of the navigation control system 10 of the present invention utilizes the 
travel vector as an element of the position history in issuing a control signal. 

The microprocessor 24 is operative to count and store the number of times a cell 
5 has been visited (cell counting) and further operative to compare this number to the 
number of times each contiguous (or neighboring) cell has been visited. For this 
navigation control algorithm, the triggering event is a numerical differential between the 
number of visits to the currently-visited cell number and the number of visits to each of 
the neighboring-cells that identifies the neighboring cell or cells that have been least- 
10 visited as compared to the currently-visited cell. The triggering event would cause the 
receiving system 20 to issue a control signal to the robotic device 100 that causes the 
robotic device 100 to move from the currently-visited cell to the neighboring cell that has 
been visited least, e.g., by implementing one or more basic maneuvers as described 
herein. If two or more neighboring cells have been visited least, the control signal would 
15 cause the robotic device to move from the currently-visited cell to the least visited 
neighboring cell that is most compatible with the current travel vector of the robotic 
device 100, e.g., minimum travel distance. 

Using Figure 4 as an example wherein "C v " identifies the currently-visited cell and 
"C c " identifies the eight (8) cells contiguous to or neighboring the currently-visited 
20 cell C V , the neighboring cells C c that have been visited a single time are the least-visited 
neighboring cells Cc. If the current travel vector for the robotic device 100 is indicated 
by the reference characters TV, the control signal would cause the robotic device 100 to 
continue moving in a straight line, i.e., the move forward basic maneuver (or the Straight- 
Line behavioral mode) would be executed by the robotic device 100 (if the robotic 
25 device 100 was currently operating in some other behavioral mode). 

One representative navigation control algorithm for the 'instantaneous position' of 
the navigational control system 10 uses elapsed time (either random or predetermined) as 
the predetermined triggering event to cause the robotic device 10 to move to a 
predetermined position B in the defined working environment. The microprocessor 24 is 
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operative, upon expiration of the elapsed time (the predetermined triggering event), to 
determine the instantaneous position (hereinafter identified as "position A") of the robotic 
device 100 as described herein. Since position A is an unknown variable until the 
predetermined triggering event is realized, the prescribed conduct, i.e., the basic 
5 maneuvers, necessary to move the robotic device 100 from position A to position B are 
also unknown. Once position A has been determined by the navigational control 
system 10, the basic maneuvers necessary to move the robotic device 100 from position 
A to position B are determinable since both position A and position B are known 
variables (in terms of their known bearing, distance parameter pairs with respect to the 

10 receiving subsystem 20). A determination of the basic maneuvers that will be 
implemented by the robotic device 100 can be accomplished by any conventional 
computational technique. 

Another exemplary navigation control algorithm for the 'instantaneous position 1 
embodiment of the navigational control system 10 is a variation of the "hot spot" 

1 5 navigation control algorithm for the 'position history' embodiment of the navigational 
control system 10. In this illustrative embodiment, both position A and position B are 
known variables and accordingly, the basic maneuvers) to move the robotic device 100 
from position A to position B are known. In this example, the predetermined triggering 
event is a True determination that the instantaneous position of the robotic device 100 is 

20 equal to position A (position A may be stored in memory 28 as a "zone" - defining some 
arbitrary area centered about position A - rather than a single point position to increase 
the probability that the instantaneous position of the robotic device 100 at some time will 
equal position A). 

The receiving subsystem 20 comprises a set of detection units 30 M where M is an 
25 integer defining the number of individual detection units comprising the set for the 
navigational control system 10. The number and positioning of the set of detection 
units 30m should be such that as much of the defined working area as possible is within 
the field-of-view of the receiving subsystem 20 and that the fields-of-view of at least two 



- 30 of 49 - 



DP-9/ISR-016 



LGU#378,024 



(but preferably more) detection units 30M cover the same area within the defined 
working area. 

In preferred embodiments of the navigational control system 10 according to the 
present invention, the receiving subsystem 20 functions as a "base station" for the 
5 system 10. In this functional role, the receiving subsystem 20 is a portable, standalone 
unit that is stationarily positioned within the defined working area, preferably abutting a 
wall bounding the defined working area (the 'wall unit' configuration). Alternatively, the 
receiving subsystem 20 can be positioned within the defined working area distally of the 
walls bounding the defined working area (the 'free-standing' configuration). The 

1 0 receiving subsystem 20 as the base station establishes and, for the 'position history' 
embodiment of the navigational control system 10, stores the grid map of cells 
representing the defined working area and represents the origin (0, 0) of the grid map of 
cells described above. 

For those embodiments where the receiving subsystem 20 is operated as a wall unit 

1 5 configuration, the individual detection units 30m have a known spaced-apart relationship 
and configured and operative to have a 180° field-of-view. For example, Figure 2 
illustrates an embodiment of the receiving subsystem 20 comprising two detection 
units 30m (M=2) spaced apart by a known angular distance "())". Figure 6C illustrates 
another embodiment of the receiving subsystem 20 comprising three detection units 30m 

20 (M=3), i.e., 30i2, 3023, 30b, having known angular separations identified by "<|>i2", "<|>23 ,f , 
and "<t>i3 M , respectively. Preferred embodiments of the wall unit configuration for the 
navigational control system 10 include three detection units 30m to provide absolute 
bearing data to the robotic device 100. A minimum of two detection units 30M are 
required to provide the necessary signal information for the receiving subsystem 20. 

25 More than three detection units 30 M can be employed to increase the resolution of the 
receiving subsystem 20, but at an added cost for each additional detection unit 30m and 
associated signal processing circuitry (see Figure 6C which illustrates the representative 
signal processing circuitry associated with a detection unit 30m). 
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For those embodiments where the receiving subsystem 20 is operated as a free- 
standing configuration, the individual detection units 30m likewise spaced apart by 
known angular distances and configured and operative have a field-of-view greater than 
1 80°. A representative embodiment of the receiving subsystem 20 operated as a free- 
5 standing base station would comprise four detection units 30m. 

The detection units 30 M are configured and operative to detect a parameter of one 
or more of the directed beams emitted by the transmitting units 14 N , e.g., voltages V 
representing the relative signal strengths of the detected directed beam(s). In a preferred 
embodiment, each detection unit 30m is configured and operative to average the detected 

10 signal strength parameter (e.g., voltage) when the detection unit 30m detects two directed 
beams simultaneously. The receiving subsystem 20 executes a signal processing 
algorithm that processes the detected parameters provided by the detection units 30M, 
i.e., relative signal strengths of the detected beams, utilizing a conventional technique to 
determine the absolute bearing between the robotic device 100 and the receiving 

15 subsystem 20. 

To provide the distance determination capability for the receiving subsystem 20, 
the receiving subsystem 20 is preferably calibrated prior to use. This involves 
positioning the robotic device 100 at a predetermined distance from the receiving 
subsystem 20 and operating one (or more) of the transmitting units 14 N to emit a directed 

20 beam at the receiving subsystem 20. The parameter of the directed beam detected by the 
detection units 30m, e.g., a voltage representing the signal strength of the directed beam 
as detected, is correlated to the predetermined distance and used to generate a look-up 
table of signal strength versus distance for the defined working area. This look-up table 
is stored in the memory module 28 of the receiving subsystem 20. As the signal strengths 

25 of directed beams are detected during operation of the navigational control system 10, the 
receiving subsystem 20 uses the detected signal strengths as pointers to the stored look- 
up table to determine the corresponding distances (between the receiving subsystem 20 
and the robotic device 100). 
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Alternatively, the receiving subsystem 20 could be configured and operative to 
implement a signal processing algorithm that utilizes the known attenuation 
characteristics, i.e., signal strength versus distance, of the operating frequency of the 
directed beams emitted by the transmitting units 14 N . This embodiment presupposes that 
5 the transmitting units 14n are rated and emitting directed beams of known signal strength. 
For the sophisticated embodiment of the navigational control system 10 according 
to the present invention described above wherein the individual transmitting units 14n of 
the transmitting subsystem 12 are operated at a unique operating frequency, the detection 
units 30m of the receiving subsystem 20 are configured to scan the set of unique operating 

10 frequencies utilized by the transmitting units 14n. The receiving subsystem 20 is 

configured and operative to cause the detection units 30m to sequentially scan through 
these frequencies during operation of the navigational control system 10. 

For the innovative embodiment of the transmitting subsystem 12 described above 
in connection with Figure 5 A, Figure 5B illustrates the operating characteristics of the 

15 complementary receiving subsystem 20. The receiving subsystem 20 is configured and 
operative to detect the directed beams emitted during the predetermined synchronization 
period t S y. At the end of the predetermined synchronization period tsv, the receiving 
subsystem 20 is operative to initiate the timing sequence to. The receiving subsystem 20 
is operative to detect the directed beams as described herein. However, the receiving 

20 subsystem 20 is further operative to determine the time at which the peak signal strength 
is detected, see reference character tpeak in Figure 5B. The receiving subsystem 20 is 
further operative to correlate the peak signal strength detection time t pea k with the known 
times at which the signal strength of the directed beam emitted by each transmitting 
unit 14n reached its peak to identify the specific transmitting unit 14n that transmitted the 

25 directed beam detected as having the peak signal strength (for the descriptive example 
presented in Figures 5 A, 5B, the third transmitting unit 143>. 

For the innovative embodiment of the transmitting subsystem 12 described above 
in connection with Figure 5C, Figure 5D illustrates the operating characteristics of the 
complementary receiving subsystem 20. The receiving subsystem 20 is configured and 
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operative to detect the directed beams emitted during the predetermined synchronization 
period tsy. At the end of the predetermined synchronization period tsy, the receiving 
subsystem 20 is operative to initiate the timing sequence to. The receiving subsystem 20 
is operative to detect the directed beams as described herein (as exemplarily illustrated by 
5 the detected signal pulses DPi, DP2, DP3, DP4 in Figure 5D). However, the receiving 
subsystem 20 is further operative to determine the two highest peak signal strengths of 
the detected directed beams, see reference characters DP 3 and DP2 in Figure 5D, which 
depict the highest and next highest detected signal pulses, and the times at which the two 
highest strength signals were detected (t2i and t3i in Figure 5D). 

10 The signal strength detection times allows the particular transmitting units 14 N on 

the robotic device 100 to be identified, i.e., transmitting units H3 and 1 42 in the example 
of Figure 5D. The receiving subsystem 20 is then further operative to compute the 
amplitude ratio of these signal pulses, e.g., DP3/DP2, and to use such computed amplitude 
ratio as a pointer to a look-up table that identifies the angular orientation of the identified 

1 5 transmitting units M3, 142, which in turn establishes the travel vector for the robotic 
device 100. 

Even though the transmitting units 14 N mounted in combination with the robotic 
device 100 are interchangeable, the specific location of each individual transmitting 
unit 14N on the robotic device 100 is a known quantity. Based upon the identification of 

20 the transmitting unit 14N that emitted the directed beam detected by the receiving 

subsystem 20, the receiving subsystem 20 can execute rather straightforward geometric 
calculations, based upon the location of the identified transmitting unit 14N, to determine 
the travel vector of the robotic device 100. 

When the receiving subsystem 20 functions as the base station, a means is required 

25 to communicate the control signal to the robotic device. Accordingly, embodiments of 
the receiving subsystem 20 that operate as a base station further include a transmitting 
unit 32 (see Figure 3). Once the navigation control algorithm implemented by the 
microprocessor 24 has determined the prescribed conduct to be implemented by the 
robotic device 10, the microprocessor 24 is operative to select the appropriate control 
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signal to implement such prescribed conduct from the memory module 28. The 
microprocessor 24 is then operative to activate the transmitting unit 32 to communicate 
(by transmitting) the control signal to the receiver unit 16 of the robotic device 100 where 
the prescribed conduct defined by the control signal is implemented by means of the 
5 microprocessing unit 135. 

While the robotic device 100 is described (and depicted in Figure 3) as being 
configured to include a dedicated receiver unit 16 for receiving control signals 
transmitted by the transmitting unit 32 of the receiving unit 20, it is preferable that the 
omnidirectional detector 128 (of the virtual wall detection system) be adapted to detect 

10 and process such control signals. For those embodiments of the navigational control 
system 10 according to the present invention wherein the receiving unit 20 is integrated 
in combination with the robotic device 10, the transmitting unit 32 is not required. 
Rather, the receiving unit 20 of the navigation control system 100 is electrically coupled 
to the microprocessing unit 135 (via an I/O port) of the robotic device 100 so that the 

1 5 receiving unit 20 can communicate control signals directly to the microprocessing 
unit 135. 

As disclosed above, in preferred embodiments of the navigational control 
system 10 according to the present invention, the receiving subsystem 20 functions as the 
base station, i.e., the wall unit configuration, and the transmitting subsystem 12 is 
20 integrated in combination with the robotic device 100. One preferred embodiment that is 
illustrative of the features and functionality of the navigational control system 10 
according to the present invention is exemplarily illustrated in Figures 6A-6C. 

Figure 6 A depicts a robotic device 100 operating in a defined working area WA 
bounded by walls W. A virtual wall unit VWU is positioned in the only entryway to the 
25 working area WA and operative to emit a confinement beam CB that confines the robotic 
device 100 to operations within the working area WA. 

The transmitting subsystem 12 of the illustrated embodiment of the navigational 
control system 10 is integrated in combination with the robotic device 100 and comprises 
a set of transmitting units 14 N (eight (8) for the described embodiment such that N equals 
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the integers 1-8) that are operative to generate a corresponding set of directed beams DBn 
(where N equals the integers 1-8) as illustrated in Figure 5B (only two directed 
beams DB3, DB4 are illustrated in Figure 5B). Reference characters BAi - BAg identify 
the propagation axes of the directed beams DBn emitted by the transmitting units 14i - 

5 14g, respectively. Each transmitting unit 14 N is configured and operative to emit a 
directed beam DBn having a predetermined emission pattern On centered about the 
corresponding beam axis B An. For the illustrated embodiment, the emission pattern On 
of each directed beam DB N is approximately 100°. 

Preferably, the predetermined emission pattern On of the directed beams DB N is 

10 correlated with the number of transmitting units 14n so that the transmitting 

subsystem 12 of the navigational control system 10 emulates an omnidirectional 
transmitting source. An omnidirectional transmitting source is necessary to ensure that 
one or more of the directed beams DB N are detected by the receiving subsystem 20 since 
the position and orientation of the robotic device 100 in the defined working area (e.g., in 

1 5 terms of its forward motion FM), with respect to the receiving station 20, is an unknown 
variable at any particular moment in time. Preferably the emission patterns On of the 
directed beams DBn overlap. 

As an examination of Figures 6 A, 6B (and in particular Figure 6B) shows, the 
directed beams DB3, DB 4 emitted by transmitting units M3, H4, respectively, will be 

20 detected by the detection units 30i, 302, 303 of the receiving subsystem 20. The detection 
units 30i, 3O2, 3O3 are operative to detect a parameter representative of the relative signal 
strengths of the detected beams DB 3 , DB4, e.g., VI, V2, V3, respectively (as disclosed 
above each detection unit 30N is operative to average the signal strengths when two 
directed beams are detected simultaneously). 

25 The receiving subsystem 20 is operative to implement the signal processing 

algorithm to compute the absolute bearing and distance between the receiving 
subsystem 20 and the robotic device 100. The receiving subsystem 20 then implements 
the navigation control algorithm to correlate the computed bearing and distance with one 
of the cells comprising the grid map of the defined working area WA stored in the 
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memory module 28, and adds such cell to the position history of the robotic device 100 to 
update the position history. The receiving subsystem 20 is then operative under the 
navigation control algorithm to determine if there is a predetermined triggering event 
associated with this updated position history. If so, the receiving subsystem 20 is 
5 operative to select the appropriate control signal, as determined by the navigation control 
algorithm, and transmit such control signal to the receiver unit 16 of the robotic 
device 100 using the transmitting system 32 (see Figure 3). The microprocessing 
unit 135 of the robotic device 100, is operative in response to the reception of the control 
signal by means of the omnidirectional detector 128, to implement prescribed conduct, 

1 0 e.g., one or more of the basic maneuvers and/or behavioral modes exemplarily described 
herein, specified by the control signal. 

An exemplary embodiment of a navigational control system 10' according to the 
present invention wherein the transmitting subsystem 12 functions as a base station and 
the receiving subsystem 20 is integrated in combination with the robotic device 100 is 

15 illustrated in Figure 7. The transmitting subsystem 12 comprises a distributed set of 
transmitting units 14N positioned to abut the walls W of the defined working area. As 
illustrated in Figure 7, the transmitting subsystem 12 comprises a first transmitting 
unit 14i, a second transmitting unit 142, and a third transmitting unit H3 positioned in 
abutting engagement with adjacent walls W, respectively. 

20 Each transmitting unit 14N comprising this distributed set is configured and 

operative to emit a directed beam having a predetermined emission pattern 6n along a 
predetermined beam axis DBn (DBi, DB2, and DB3 in Figure 7 define the predetermined 
beam axes for the distributed transmitting units 14\, 142, H3, respectively) at a unique 
operating frequency, preferably in the infrared frequency range and preferably modulated 

25 as disclosed herein. Preferably, each transmitting unit 14i, 142, M3 is configured and 
operative to generate a predetermined beam emission pattern On that effectively covers 
the defined working area WA, i.e., On is approximately 180° for the distributed 
transmission subsystem 12 depicted in Figure 7. 
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The receiving subsystem 20 for the navigational control system 10 f preferably 
comprises a single omnidirectional detection unit 30 which may be of the type described 
in commonly-owned, co-pending U.S. Patent Application Serial No. 10/056,804, filed 24 
January 2002, entitled Method and System for Robot Localization and Confinement 
5 (the virtual wall system summarily described herein). The omnidirectional detection 
unit 30 is configured and operative to scan through the unique operating frequencies 
utilized by the distributed transmitting units 14i, 142, 143. 

The omnidirectional detection unit 30 is operative to detect the directed 
beams DB1, DB2, DB3 emitted by the distributed transmitting units 14 h 14 2 , 14 3 . The 

10 receiving subsystem is configured and operative to process the signals of the detected 
directed beam to determine the absolute position of the robotic device 100 within the 
defined working area WA. This absolute position is defined in terms of a cell of the grid 
map of the defined working area WA. A sequence of absolute positions, determined as 
described above, identifies a sequence of cells that defines the position history of the 

1 5 robotic device 1 00. 

The receiver subsystem 20 is operative as described above to utilize a navigation 
control algorithm to determine whether a triggering event has occurred in the position 
history, and if a trigger event has occurred, the receiver subsystem 20 is operative to 
communicate the control signal associated with the triggering event/navigation control 

20 algorithm to the robotic device 100. The robotic device 100 is operative, in response to 
the communicated control signal, to implement the prescribed conduct specified by the 
control signal. 

A variety of modifications and variations of the present invention are possible in 
light of the above teachings. The navigational control system 10 according to the present 
25 invention has been described above as determining and using the instantaneous position 
(or a sequence of instantaneous positions) of a robotic device as a control parameter for 
directly altering the movement activity of the robotic device. One skilled in the art will 
appreciate that the navigational control system according to the present invention can be 
used for other purposes. For example, the navigational control system of the present 
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invention can be used for correcting errors in movement activity of robotic devices 
relying upon dead reckoning. It is therefore to be understood that, within the scope of the 
appended claims, the present invention may be practiced other than as specifically 
described herein. 
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